Trakai

The town is small enough for everything to be reached on foot, but there are also buses running from the bus station where the buses from Vilnius also arrive/depart to the castle.